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VIDEO BROWSER BASED ON CHARACTER REI*ATION 



BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to a video browser, and more 
particularly to a video browser for browsing a video based on 
relations between characters. 
Background of the Related Art 

Typically, users simply view movies and/or dramas as 
broadcasted through a TV or played at a movie theater. However, 
a user may wish to view a particular movie or drama at a 
particular time, or wish to view only a particular section of a 
movie or a drama. Accordingly, various techniques which enables 
a selective watching of a movie/drama or sections of a 
movie/drama have been suggested. 

In the related art, for example, various video data may be 
represented or classified into format chunk, index chunk, media 
chunk, segment chunk, target chunk, and/or representation chunk. 
Also, data on various characters or objects such as a name of an 
object, . position on the screen, numeric data with relation to a 
segment of the video data in which the object appears, may be 
represented by the target and representation chunk- Accordingly, 
a user can select an object through a table and reproduce for 
display a particular segment where the object is shown in the 
video . 

In another related art, various additional data of a video 
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data are obtained before, during or after the production of the 
video data. Thereafter, an additional information table of the 
obtained data is composed and provided to users. Namely, the 
additional data table may include a position where an actor 
5 appears, a position where a character of the actor appears, and 
a position where stage properties appear, such that a scene can 
be reproduced as selected by a user through the additional data 
table. For example, if a user selects a stage property, 
information on the selected stage property such as the 
10 manufacturer and price may be displayed on a screen, and the user 
/r may be able connect with the manufacturer or a seller of the 
~i: stage property through a network connection, 

^ : In still another related art, recording information on each 

H segment of a video in a video map has been suggested. That is, 
15 information such as the degree of violence, the degree of adult 
rf. contents, the degree of importance of contents, characters 
jj:: positions, and the degree of difficulty in understanding may be 
tf indicated for each segment of a video in the video map. Thus, the 
user may set a degree of preference for one or more items of the 
20 video map, and only segments of the video meeting the set degree 
of preference would be reproduced, thereby limiting a display of 
particular contents to unauthorized viewers. 

Similarly, other techniques in the related art as described 
above provide items simply arranged without any relation to the 
25 objects appearing in the movie or drama, based upon the selection 
of the user. However, the contents of a movie or drama generally 
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builds around relations between characters, places and events. 
For example, relations between characters may not change from 
beginning to the end of the story or may continuously vary. 
Moreover, since one or more characters relate to a specific 
5 character in the movie or drama, the browsing method in the 
related art substantially fails to provide an accurate 
understanding of the story of the movie or drama to the user. 

Therefore, techniques in the related arts have disadvantages 
in that it is difficult to understand a video centering on 
10 relations among characters according to the development of 
events, changes of relations, and relations among characters and 
places as events develop . 



H SUMMARY _QF THE INVENTION 

Accordingly, an object of the present invention is to solve 
I§ at least the problems and disadvantages of the related art. 

Another object of the present invention is to provide a 
video browser in which event segments showing changes in 
relations between characters are summarized and displayed based 
on a video data structure which includes characters in a video 
20 that significantly act on development of an event, and includes 
a constant and variable relations between characters. 

A still another object of the present invention is to 
provide a video browser in which main events that significantly 
act on variable relations between characters are connected with 
25 corresponding variable relations based on a video data structure 



3 
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which includes characters in a video that significantly act on 
development of an event, and includes a constant and variable 
relations between characters. 

A further object of the present invention is to provide a 
video browser in which a key frame of event segments which show 
a corresponding relation between characters is displayed based 
on a video data structure which includes characters in a video 
that significantly act on development of an event, and includes 
a constant and variable relations between characters. 

A further object of the present invention is to provide a 
J video browser in which a constant relation and changes in 
^ relations between characters are displayed depending on preset 
^- relation types based on a video data structure which includes 
M; characters in a video that significantly act on development of 
an event ' and includes a constant and variable relations between 
rfj characters . 

in Additional advantages, objects, and features of the 

g invention will be set forth in part in the description which 
follows and in part will become apparent to those having ordinary 
skill in the art upon examination of the following or may be 
learned from practice of . the invention. The objects and 
advantages of the invention may be realized and attained as 
particularly pointed out in the appended claims. 

To achieve the objects and in accordance with the purposes 
25 of the invention, as embodied and broadly described herein, a 
video browsing system for browsing a video based on a data 

4 
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structure in which a constant and variable relations between 
characters of a video are connected with characters and 
corresponding event segments, comprises (a) browsing and 
displaying a video segment showing a constant relation between 
5 characters and variable relations between characters based on an 
event segment showing a corresponding constant relation and 
variable relation, and (b) displaying a video segment of a 
corresponding event segment in response to a user's selection. 

The video browser of the present invention is characterized 

10 in that event segments showing a constant relation between 
characters and changes in the relations is summarized and 
displayed, Also, main events that significantly act on variable 

*L; relations are connected with corresponding variable relations and 

H characters . 

15 Moreover, the video browser of the present invention is 

Og characterized in that constant relation and variable relation 
Iri between the characters are browsed and displayed as a constant 
i relation and a variable relation between characters selected by 

the user. The constant relation and variable relation between 
20 characters may also be browsed and displayed as a constant 

relation and a variable relation between every characters related 

with a selected character. 

In still another video browser of the present invention, the 

constant relation and variable relation between characters are 
25 displayed in a tree structure. The video browser of the present 

invention may display a constant relation and variable relation 
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between characters depending on preset relation types. The 
relation types may be set in semantic types such as f family 
relation, 1 'business relation,' and 'social relation. 1 

Furthermore, the video browser of the present invention is 
5 characterized in that event segments showing constant relation 
and variable relation between characters is displayed as a key 
frame. Finally, the key frame may shows a corresponding relation 
between characters . 

BRXEF DESCRIPTION OF THE DRAWINGS 

If) The present invention will be described in detail with 

f; reference to the following drawings in which like reference 

numerals refer to like elements wherein: 
H Fig* 1 shows an example of a video data structure based on 

1 character relation according to the present invention; 

DS Fig. 2 shows an example of a video data structure in which 

IJ1 events showing character relations are summarized in accordance 
R. to the present invention; 

Fig. 3 shows a video browser based on the video data 
structure of Fig- 2; 

2 0 Fig. 4 shows a video data structure of an event segment 

showing variable relations between characters; 

Fig. 5 shows a video browser based on the data structure of 
Fig. 4 in accordance with the present invention; 

Fig. 6 shows an example of a video browser according to the 
25 present invention; and 

6 
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Fig* 7 shows another example of a video browser according 
to the present invention. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

Reference will now be made in detail to the preferred 
5 embodiments of the present invention, examples of which are 
illustrated in the accompanying drawings. 

Fig- 1 shows a video data structure based on character 
relations in accordance with the present invention for a video 
browser based on content. A video browser based on content is 
W disclosed in co-pending application 09/239, 530, entitled 
> "Motional Video Browsing Data Structure and Browsing Method 
^ Therefor," and is fully incorporated herein. 

f~ Referring to Fig. 1, a visual description scheme (DS) 101 

1^ is divided into a visualization DS 102, a syntactic structure DS 
IS 103, and a semantic structure DS 104. The visualization DS 102 
is organised into a highlight view DS 105 for displaying a 
R summarized data as a video highlight, and a key frame view DS 106 
for displaying summarized data based on a key frame. Because, a 
video plot can be summarized briefly or with greater amounts of 
20 detail, the highlight view DS 105 enables a display of multi- 
levels of summarized data with a level 107, a view type 108 and 
a time DS 109. Similarly, the key frame view DS 106 enables a 
display of multi-levels of summarized data with a level 110 and 
a time DS 111. 

25 Namely, the highlight view DS 105 is organized into a level 

7 
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107 which has multiple levels of highlight data based upon a 
degree of detail in summarizing a video. In such case, summary- 
data in each level may include a corresponding period in the time 
DS 109 for use in highlight. The key frame view DS 106 is also 
5 organized into a level 110 which has multiple levels of 
summarized data based upon a degree of detail. In such case, 
summary data in each level may include a corresponding period in 
the time DS 111 for use as a key frame. 

The syntactic structure DS 103 is used for displaying the 
10 actual video and includes actual video segments to be displayed, 
J The syntactic structure DS 103 is organized into actual video 
^ segments in segment DSs 112, and corresponding temporal positions 

of video segments in the time DS 113. 
H ; The semantic structure DS 104 includes additional 

15 information describing a video, and is organized into an event 
|g DS 114 including event information, an object DS 117 including 
object information, and an event /object relation graph DS 119 
j!i including information describing relations between objects and 
places, and corresponding events to the relations. Namely, the 
20 event DS 114 describes events, and the object DS 117 describes 
objects such as characters and places. The event /object relation 
graph DS 119 describes a constant relation or changes in relation 
between characters, a relation between object and place, or a 
relation between object and event* 
25 Here, a constant relation means either a relation between 

characters that cannot change throughout a video, such as a 
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patent to child relation, or a relation which is most 
representative of the relations between characters* 

When an event is selected to display a video segment 
corresponding to the event, the event DS 114 of the semantic 
5 structure DS 104 is used. The event DS 114 is divided into a 
Reference to Segment 115 including information necessary for 
displaying a segment of a video corresponding to the selected 
event and an annotation DS 116 including information which 
connects events with actual positions of the events in a video 
10 and information for explaining events in a video- Particularly, 
~5 the event DS 114 is used in displaying a selected event and 
^; connects the selected event with a position of the event in a 
IP video data through the Reference to Segment 115, and the contents 
M: of a selected event is annotated through the annotation DS 116. 
15 The object DS 117 is organized into an object annotation DS 

-5 118 including information for describing objects such as 
^ characters or places. That is, the object DS 117 is used in 
^ displaying characters, and detailed information of the characters 

can be summarized or annotated through the annotation DS 118. 
20 The event /object relation graph DS 119 includes information 

on a constant relation and variable relation between characters. 
The event/object relation graph DS 119 is organized into an 
entity relation 120 with a return which allows a display of 
character relations in a tree structure in which a relation may 
25 have subordinate relations. According to the present invention, 
constant relations between characters are placed in an upper 
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level of the tree while changes of relations between the 
characters are placed in a lower level of the tree. 

The entity relation 212 is also divided into a relation 121, 
a Reference to Object 124, and a Reference to Event 125. The 
5 relation 121 is organized into a name 122 including information 
on the titles of relations, and a type 123 including information 
on the nature of relations. For example, a nature of relation may 
be 'family 1 and a title of relation may be 'spouse. 1 The 
Reference to Object 124 connects related characters with each 

0 other and the Reference to Event 125 connects events which shows 
t particular relations > 

1 In the above video data structure, the notation above each 
data such as {0,1}, {0,*}, or {1,*} indicates the number of data 
for the corresponding data. For example, the notation of {0,1} 

5 for the visualization DS 102 indicates that the visual DS 101 can 
have zero or one visualization DS * On the other hand, the 
notation of {0,*} for the segment DS 112 indicates that the 
syntactic structure DS 103 may have from zero to any number of 
segment DS. 

Fig. 2 shows a. method of using a data structure of Fig. 1 
to easily understand and browse a video based on a relations 
between characters. Referring to Fig. 2, a representative 
relation (constant relation) between 'character 1' and Character 
2 1 is placed at the top of the tree structure, and variable 
relations (relation 1 ~ relation 4) between 'character 1' and 
'character 2 T are placed at the bottom of the tree structure. 

10 
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Also, main events which are significant in a change of relation 
in a variable relation are placed between variable relations. The 
main events are summarized video data and are displayed by 
highlight data. 

5 Here, the events are connected through the Reference to 

Event 125 in the entity relation 120 and the video segments are 
connected through the Reference to Segment 115 in the event DS 
114. Thereafter, an actual video segment is displayed by 
connecting the time DS 113 of the segment DS 112 with the time 

10 DS 109 of the level 107 in the highlight DS 105 of the visual DS 

^ 102. 

F ^9' 3 shows an example screen of a video browser based on 
Uj the video data structure of Fig. 2. Referring to Fig. 3, 
I- 'character n' of a video is displayed on a character screen 301, 
15 and a video is displayed on a main screen 302 according to a 
selection received through a user interface 303. 

For example, if a user selects 'character 1' and 'character 
31 from the character screen 301, main events which are 
significant in bringing about a change in the variable relations 
20 between 'character 1' and 'character 3 1 can be browsed based on 
the data structures of Figs. 1 and 2. As a result, contents 
corresponding to the main events are summarized and displayed on 
the main screen 302. 

Fig. 4 shows another method of using a video data structure 
!5 including information on variable relations of characters and 
main events significant in the variable relations. 

11 
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Referring to Fig. 4, an representative relation (constant 
relation) between 'character 1' and 'character 2 T is placed at 
a top of a tree structure, and variable relations (relation 1 ~ 
relation 4) between Character l r and f character 2 T are placed 
5 at the bottom of the tree structure. Main events (event 1 - event 
3) which are significant in bringing about a change in the 
variable relations are placed between the variable relations. The 
method of Fig. 4 is realized in such a manner that a main event 
segment which brings a new relation is connected with the 

10 variable relations through the Reference to Event 125 of the 

% entity relation 120. 

"% Fig. 5 shows a video browser in accordance with the present 

yj invention based on the data structure of Fig. 4. Referring to 

H Fig. 5, characters in a video are displayed on a character screen 
15 501, and connection between variable relations and events are 
H displayed on a character relation-variable event screen 502. 
Also, an event segment corresponding to a variable relation can 
be reproduced and displayed on a main screen 503. 

For example, if a viewer selects 'character 1' and 
20 'character 3, 1 variable relations between 'character 1' and 
'character 3,' and main events which are significant in bringing 
about a change in the variable relation are respectively 
displayed on the screen 502. At this time, a relation or event 
may be displayed by an key frame or annotation. Also, a video 
25 segment corresponding to an event such as 'event 2 T selected from 
the screen 502 is reproduced and displayed on the main screen 
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503. 

Fig, 6 shows another example screen of a video browser 
according to the present invention. Referring to Fig. 6, main 
characters of a video are displayed on a character screen 601. 
5 Also, characters having relations with a character selected from 
the character screen 601 , and a constant relation and variable 
relations between the selected character and related characters 
are displayed on a relation screen 602. 

At this time, a constant relation between the selected 
10 character and a related character is displayed on the top of a 
relation tree structure while variable relations between the 
selected character and the related character is displayed on the 
yj bottom of the tree structure* 

H= Furthermore, a key frame of events significant in both the 

15 constant relation and variable relations is displayed on a main 
;~2 scene screen 603* Here, key frames of event segment corresponding 
jj^ to a type(s) of event may be displayed on the main scene screen 
% according to a user selection through a selection screen 604* 
Namely, key frames of main event segments which directly show a 
20 selected relation or key frames of secondary event segments which 
indirectly show the selected relation, or both can be displayed 
according to the user selection* For example, if a selected 
relation is a husband and wife, a main event segment may be a 
video segment of a marriage ceremony while a secondary event 
25 segment may be a video segment of third parties discussing the 
marriage ceremony , 

13 
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An event segment corresponding to an event, for example a 
key frame, selected from the main scene screen 603 can thus be 
reproduced and displayed on the main screen 605. 

For example, when a user selects 'character 1' from among 
5 the characters in the character screen 601, other characters 
'character 2' - 'character 4 1 related with 'character 1 ? are 
displayed on the relation screen 602. If 'relation 2 1 with 
'character 2' is selected from the relation screen 602, event 
segments corresponding to 'relation 2' with 'character 2' is 
10 displayed on the main scene screen 603 as key frames. Also, a 
period of a video corresponding to 'event 6' selected from the 
main scene screen 603 is reproduced and displayed on the main 
^; screen 605. 

H 5 At this time, the video browser of Fig* 6 can be implemented 

15 by setting a relation type in the data structure of Fig. 1. in 

other words, events connected with a relation may vary depending 
1% on whether the type 123 of the relation 121 is the direct or 
^ indirect type as discussed above. Also, the events are connected 

through the Reference to Event 125 of the entity relation 120 and 
20 event segments are connected through the Reference to Segment 115 

of the event DS 114. Thereafter, an actual video segment is 

displayed by connecting the time DS 113 of the segment DS 112 

with the time DS 111 of the level 110 in the key frame view DS 

106 of the visual DS 102- 
25 Fig. 7 shows still another example screen of a video browser 

according to the present invention. Referring to Fig. 7, 
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characters of a video are displayed on a character screen 701; 
and character having relations with a selected character, and a 
constant relation and a variable relation between the selected 
character and related characters are displayed on a relation 
5 screen 702. Here, the constant and variable relations may 
categorized into different natures of relations and relations 
corresponding to a particular nature (s) of relation selected 
through a selection screen 703 may be displayed in the relation 
screen. The nature of relation may be a family relation, a 
10 business relation, or a social relation* 

"f ; Thus, a key frame of events significant in the selected 

nature {s) of relation is displayed on a main scene screen 704 f 
ifj A video segment corresponding to the selected relation and event 
M* is reproduced and displayed on a main screen 705* For example, 
15 when a user selects 'character 1 T from characters displayed on 
fo the character screen 701, characters ('character 2 1 - 'character 
4 f ) having a social relation with T character 1' may be displayed 
!f and an event segment of 'event 6 f corresponding to 'social 
relation 2 1 with 'character 2 1 can be reproduced and displayed 
20 on the main screen 705. 

As in Fig. 6, a constant relation between a selected 
character and a related character is displayed on the top of a 
relation tree structure while variable relations between the 
selected character and the related character is displayed on the 
25 bottom of the tree structure. 

The video browser of Fig. 7 can be realized by setting a 

15 
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relation type 123 of the relation data 121 in the data structure 
of Fig, 1, In other words, events related with the relation data 
121 may vary depending on whether the relation type 123 of the 
relation data 121 is a 'family relation, ' a 'business relation,' 
5 or a 'social relation-' As a result, browsing of Fig. 7 can be 
performed. At this time, the events are mutually connected 
through the reference to event 125 of the real relation 120. 
Segments are mutually connected through the reference to segment 
115 of the event DS 114- Then, the time DS 113 of the segment DS 

10 112 is connected with the time DS 111 of the level 107 displayed 
in the key frame DS 106 of the visual DS 102. 

% As aforementioned, the video browser based on a character 

relation according to the present invention has the following 

M* advantages. The event periods of the variable relation between 

15 the characters are summarized and displayed, and the main events 

gj concerned in the variable relation between the characters are 

connected between the variable relations and then displayed. 

'% Furthermore, the data structure for browsing a video is 

based on a relation between characters and a variable relation 

20 between them. A key frame of an event period showing a 
corresponding relation between the characters clearly or 
directly, or a key frame of an event period showing it with hint 
or indirectly can be displayed based on the data structure. Also, 
the relations between the characters are divided into a family 

25 relation, a social relation, and an emotion relation to be 
selectively provided to a user, so that video browsing can be 

16 



RUG. 25.2000 3= 14PM A 



NO . 462 P. 23 



performed based on the relations between the characters. 

Accordingly, contents of the video can be browsed based on 
characters that significantly act on development of a story of 
a movie or drama, the relation between the characters , and the 
5 variable relation between them- After all, the user can easily 
browse the video based on characters, event and relation which 
are concerned in development of a story and important for 
contents of a real video. Also, the user can understand and 
browse a desired video in various types based on the video data 
10 structure which represents characters and their relation, 
i Furthermore, the present invention may be applied to a VOD 

'1~ system in the broadcasting field so that the user can view a 

H: desired part. This could lead to an advantage that the user can 

H= reproduce and view the desired part within short time and to 
45 effective utilization of the network source* Also, the present 
m invention may be applied to a video player for home use and a 

In broadcasting video player so that the video browsing environment 
2 can be provided to easily browse a desired part of a movie or 

drama stored in the video player. 
20 The foregoing embodiments are merely exemplary and are not 

to be construed as limiting the present invention. The present 
teachings can be readily applied to other types of apparatuses. 
; The description of the present invention is intended to be 

1 illustrative, and not to limit the scope of the claims. Many 

i 

! 25 alternatives, modifications, and variations will be apparent to 
those skilled in the art. 

17 
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WHAT IS/CIAJMED 15: 

1, A video browsing system comprising: 

a character screen which displays characters of a video; and 
a main screen which displays video segments corresponding 
5 to significant events showing a relation between two displayed 
characters of said character screen according to a user 
selection/ wherein said relation may be constant or variable, 

2. A system of claim 1, wherein the main screen displays 
said video segments by a summary data of said video segments. 

l:p 3. A system of claim 1, wherein a user selects two 

pi characters through the character screen to display the video 

H segments corresponding to significant events showing a relation 

"L between the two displayed characters * 

111 4 , R system of claim 1, further comprises a character 

CES relation-variable event screen which displays connections between 
variable relations and significant events. 

5. A system of claim 4, wherein the character relation- 
variable event screen displays either one or both the variable 
relations and events by key frames • 

20 6 * A system of claim 1, further comprising; 

a relation screen which displays constant relations and 

18 
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variable relations between a character selected from the 
character screen and related characters, wherein said constant 
relations and variable relations are displayed in a tree 
structure; and 

5 a main scene screen which displays significant events 

corresponding to one of either a constant relation or variable 
relation selected from the relation screen, 

7. A system of claim 6, wherein the constant relation is 
displayed on a top level of said tree structure and variable 
Kp relations are displayed on lower levels of said tree structure. 

L; 8. A system of claim 6, wherein the main scene screen 

f~ displays the significant events by key frames. 



03 9* A system of claim 6, further comprising a selection 

screen wherein the main scene screen displays either one or both 

| i 5 main significant events or secondary significant events 
corresponding to said relation selected from the relation screen, 
according to a user selection through said selection screen. 

10. A system of claim 6, further comprising a selection 
screen wherein the relation screen displays constant relations 
20 and variable relations corresponding a relation type selected by 
a user through said selection screen* 



19 
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! 

11. A system of jclaim 10, wherein a relation type may be one 
of a family relation] a business relation, or a social relation. 



12* A video dajta structure for a video browsing system 
comprising i , 

i 

5 a visualization! DS which includes a highlight view DS for 

display for displaying event data by a highlight and a key frame 
view DS for displaying event data as key frames,, wherein the 
highlight view DS is j>rganized into multiple levels which enables 
a display of multi-levels of highlight data and wherein the key 

lip frame view DS is organized into multiple levels which enables a 

jb display of multi-lev^ls of summarized data; 

a syntactic structure DS which includes information for 
displaying actual vicleo segments of a video; and 

Jl a semantic structure DS which includes additional 

£1 information describing a video . 

p 13. A video dkta structure of claim 12, wherein the 

syntactic structure lj>S is organized into a segment DS including 
actual video segment jdata and a time DS including corresponding 
temporal positions of each actual video segment data within a 

20 video data. j 

! 

j 

14. A video data ' structure of claim 13/ wherein the semantic 
structure DS is organized into sub-level structures comprising: 
an event DS which includes event information, wherein said 
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event DS is organized into sub-level structures of a reference 
to segment which includes reference information necessary for 
displaying a video segment of a video corresponding to events 
selected by a user and an annotation DS which includes 
5 information which connects said selected events with actual 
positions of said selected events within a video data and 
information explaining said selected events; 

an object DS which includes object information; and 
an event/relation graph DS which includes information on at 
10 least one of constant relations between objects, variable 
relations between objects, or relations between objects and 
events, wherein said event/object relation graph DS is organized 
/fj into an entity relation with sub-level structures of a Reference 
H to Object which connects objects having either a constant 
15 relation or variable relation, a Reference to Event which 
a connects events which are significant to a relation between each 
lp connected objects, and a relation which includes information on 
K a nature and title of relation between each connected objects. 

A video browsing system comprising: 
20 a character screen which displays characters of a video; and 

a main screen which displays video segments corresponding 
to significant events showing a relation between two displayed 
characters of said character screen according to a user 
selection, wherein said relation may be constant or variable. 
25 a relation screen which displays constant relations and 
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variable relations between a character selected from the 
character screen and related characters, wherein said constant 
relations and variable relations are displayed in a tree 
structure; and 

5 a main scene screen which displays significant events 

corresponding to one of either a constant relation or variable 
relation selected from the relation screen . 

16. A system of claim 15, wherein the constant relation is 
displayed on a top level of said tree structure and variable 
fig relations are displayed on lower levels of said tree structure- 

;I: 17. A system of claim 15, wherein the character screen, the 

H main screen, the relation screen, and the main scene screen are 

displayed using a video data structure comprising: 
05 a visualization DS which includes a highlight view DS for 

W display for displaying event data by a highlight and a key frame 
□ view DS for displaying event data as key frames, wherein the 
highlight view DS is organized into multiple levels which enables 
a display of multi-levels of highlight data and wherein the key 
frame view DS is organized into multiple levels which enables a 
20 display of multi-levels of summarized data; 

a syntactic structure DS which includes information for 
displaying actual video segments of a video; and 

a semantic structure DS which includes additional 
information describing a video. 

22 
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18. A system of claim 15, further comprising a selection 
screen wherein the main scene screen displays either one or both 
main significant events or secondary significant events 
corresponding to said relation selected from the relation screen, 

5 according to a user selection through said selection screen, 

19. A system of claim 15, further comprising a selection 
screen wherein the relation screen displays constant relations 
and variable relations corresponding a relation type selected by 
a user through said selection screen, 

IP 20 * A system of claim 19, wherein a relation type may be one 

yj of a family relation, a business relation, or a. social relation. 
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ABSTRACT OF THE DISCLOSURE 

A video data structure and a video browser for video 
browsing based on content is disclosed. The present invention 
allows users to easily understand relations between characters 
5 and changes in relations between characters in a movie or drama 
by displaying significant events in connection to corresponding 
relations and by displaying character relations in a tree 
structure. 
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As a below named inventor, I hereby declare that: 

My residence, post office and citizenship are as stated below next to my name, 

( believe I am the original, first and sole inventor (if only one name is listed below) or an original, first and joint inventor (if plural names 

are listed below) of the subject matter claimed and for which a patent is sought on the invention entitled 

VIDEO BROWSER BA'SED ON CHARACTER RELATION 



_* the 



specification of which 

[ X ] is attached hereto [ ] was filed on as Application Serial No. , an4 was 

amended on — ( if applicable) 

I hereby state that I have reviewed and understand the contents of the above identified specification, including the claims, as amended by 
any amendment referred to above. 

I acknowledge the duty to disclose information which is known to me to be material to patentability in accordance with Title 37, Code of 
Federal Regulations, Section 1.56(a). 

( hejlby claim foreign priority or provisional application benefits under Title 35, United States Code, Section 119 of any foreign 
apflication(s) for patent or inventor's certificate, or provisional application^) listed below and have also identified below any foreign 
app|£ation for patent or inventor's certificate, or provisional applications) having a filing date before that of the application on which 
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Prior Foreign Application^) or U.S. Provisional Application^): Priority Claimed 

Number Country Pav/Month/Year, Yes No 

35688/1999 Korea August/26/1999 X 
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II; 1 hereby claim the benefit under Title 35, United States Code, Section 120 of any United States applications) listed below and, 
insofar as the subject matter of each of the claims of this application is not disclosed in the prior United States application in the manner 
preluded by the first paragraph of Title 35, United States Code, Section 1 12, 1 acknowledge the duty to disclose material information as 
defined in Title 37, Code of Federal Regulations, Section 1.56(a) which occurred between the filing date of the prior application and the 
national orFCT international filing date of this application: 

Prior U. S. Applications): 

Serial No. Filing Date Status: Patented. Pending, Abandoned 



t hereby declare that all statements made herein of my own knowledge are true and that all statements made on information and belief are 
believed to be true; and further that these statements were made with the knowledge that willful false statements and the like so made are 
punishable by fine or imprisonment, or both, under Section 1001 of Title 1 S of the United States Code and that such willful folse statements 
may jeopardize the validity of the application or any patent issued thereon. 
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36,647, all of 

The Law Offices of 

FLESHNER&KIM 

P, O. Box 22 1200 
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With full power of substitution and revocation* to prosecute this application and to transact alt business in the Patent and Trademark Office 
connected therewith, and all future correspondence should be addressed to them. 
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